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The class of multivariate Levy-driven autoregressive moving average (MCARMA) processes, the 
continuous-time analogs of the classical vector ARMA processes, is shown to be equivalent to the 
class of continuous-time state space models. The linear innovations of the weak ARMA process 
arising from sampling an MCARMA process at an equidistant grid are proved to be exponentially 
^ I completely regular (/3-mixing) under a mild continuity assumption on the driving Levy process. 

It is verified that this continuity assumption is satisfied in most practically relevant situations, 

fT^ ' including the case where the driving Levy process has a non-singular Gaussian component, is 

compound Poisson with an absolutely continuous jump size distribution or has an infinite Levy 
measure admitting a density around zero. 

•^- j ' Keywords: complete regularity; linear innovations; multivariate CARMA process; sampling; 

^T^ I state space representation; strong mixing; vector ARMA process 

1. Introduction 

><■ 

^ , CARMA processes are the continuous-time analogs of the widely known discrete-time 

.^.' ARMA processes (see, e.g., [8] for a comprehensive introduction); they were first defined 

in [12] in the univariate Gaussian setting and have stimulated a considerable amount of 
research in recent years (see, e.g., [5] and references therein). In particular, the restriction 
of the driving process to Brownian motion was relaxed and [6] allowed for Levy processes 
with finite logarithmic moments. Because of their applicability to irregularly spaced ob- 
servations and high-frequency data, they have turned out to be a versatile and powerful 
tool in the modeling of phenomena from the natural sciences, engineering and finance. 
Recently, [19] extended the concept to multivariate CARMA (MCARMA) processes with 
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2 E. Schlemm and R. Stelzer 

the intention of being able to model the joint behavior of several dependent time series. 
MCARMA processes are thus the continuous-time analogs of discrete-time vector ARMA 
(VARMA) models (see, e.g., [18]). 

The aim of this paper is twofold: first, we establish the equivalence between MCARMA 
and multivariate continuous-time state space models, a correspondence which is well 
known in the discrete-time setting [14]; second, we investigate the probabilistic proper- 
ties of the discrete-time process obtained by recording the values of an MCARMA process 
at discrete, equally spaced points in time. A detailed understanding of the innovations 
of the weak VARMA process which arises is a prerequisite for proving asymptotic prop- 
erties of statistics of a discretely observed MCARMA process. One notion of asymptotic 
independence which is very useful in this context is complete regularity (sec Section 4 
for a precise definition) and we show that the innovations of a discretized MCARMA 
process have this desirable property. Our results therefore not only provide important 
insight into the probabilistic structure of CARMA processes, but they are also funda- 
mental to the development of an estimation theory for non-Gaussian continuous-time 
state space models based on equidistant observations. 

In this paper, we show that a sampled MCARMA process is a discrete-time VARMA 
process with dependent innovations. While the mixing behavior of ARMA and more 
general linear processes is fairly well understood (see, e.g., [1, 20, 21]), the mixing prop- 
erties of the innovations of a sampled continuous-time process have received very little 
attention. From [9], it is only known that the innovations of a discretized univariate 
Levy-driven CARMA process are weak white noise, which, by itself, is typically of little 
help in applications. We show that the linear innovations of a sampled MCARMA pro- 
cess satisfy a set of VARMA equations and we conclude that under a mild continuity 
assumption on the driving Levy process, they are geometrically completely regular and, 
in particular, geometrically strongly mixing. This continuity assumption is further shown 
to be satisfied for most of the practically relevant choices of the driving Levy process, 
including processes with a non-singular Gaussian component, as well as compound Pois- 
son processes with an absolutely continuous jump size distribution and infinite activity 
processes whose Levy measures admit a density in a neighborhood of zero. 

This paper is structured as follows. In Section 2 we review some well-known properties 
of Levy processes, which we will use later. The class of multivariate CARMA processes, in 
a slightly more general form than in the original definition of [19], is described in detail in 
Section 3 and shown to be equivalent to the class of continuous-time state space models. 
In Section 4 the main result about the mixing properties of the sampled processes is 
stated and demonstrated to be applicable in many practical situations. The proofs of the 
results are presented in Section 5. 

We use the following notation. The space oimxn matrices with entries in the ring K is 
denoted by M„i^„(IK) or A/m(]K) if m = n. A^ denotes the transpose of the matrix A, the 
matrices !„ and Om are the identity and the zero element of Mm (K) , respectively, and 
A® B stands for the Kroncckcr product of the matrices A and B. The zero vector in R™ 
is denoted by 0™, and || • || and (•,•) represent the Euclidean norm and inner product, 
respectively. Finally, ]K[z] (K{z}) is the ring of polynomial (rational) expressions in z 
over K and /_b(-) is the indicator function of the set B. 
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2. Multivariate Levy processes 

In this section we review the definition of a multivariate Levy process and some elemen- 
tary facts about these processes which we will use later. More details and proofs can be 
found in, for instance, [23]. 

Definition 2.1. A (one-sided) W" -valued Levy process (L(t))t>o is a stochastic process 
with stationary, independent increments, continuous in probability and satisfying L(0) = 
Om almost surely. 

Every M^-valued Levy process (L(i))t>o can be assumed to be cadlag and is completely 
characterized by its characteristic function in the Levy-Khintchine form Ee'^"''^'^*)^ = 
cxp{tip^ (u)} , u G M™, i > 0, where ip^ has the special form 

V'L(u)=i(7,u)-i(u,I]eu)+ / [e'<"^->-l-i(u,x)/{||,||<i}]^L(dx). 

The vector 7 £ M™ is called the drift, the non-negative definite, symmetric m x m ma- 
trix S^ is the Gaussian covariance matrix and v^ is a measure on R™, referred to as 
the Levy measure, satisfying 

i^^{{Om})^0, I min(||x||2,l)i.L(dx)<oo. 

JR'" 

We will work with two-sided Levy processes L = (L(i))tgR. These are obtained from two 
independent copies (Li(i))4>o, (L2(i))t>o of a one-sided Levy process via the construction 

\U{t), t>0, 

Mt) = < - lim Lafs), i<0. 

Throughout the paper, we restrict our attention to Levy processes with zero means and 
finite second moments. 

Assumption LI. The Levy process L satisfies EL(1) = and E||L(l)|p < 00. 

The assumption EL(1) = is made only for notational convenience and is not es- 
sential for our results to hold. The premise that L has finite variance is, in contrast, 
a true restriction, which is very often made in the analysis of (C)ARMA processes. 
The treatment of the infinite variance case requires different techniques and often does 
not lead to comparable results. It is well known that L has finite second moments 
if and only if /||x||>i l|x|pi^(dx) is finite, and that S'" = EL(1)L(1)''" is then given by 
4,„xxTz.L(dx)+Se. 

3. MCARMA processes and state space models 

If L is a two-sided Levy process with values in R™ and p > q are positive integers, 
then the d-dimensional L-driven autoregressive moving average {MCARMA) process with 
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autoregressive polynomial 

z^ P{z) ■.= ldzP + AizP-^ + ■ 
and moving average polynomial 

z ^ Q{z) := Bozi + Biz'-i + • 
is thought of as the solution to the formal differential equation 



Ap e Md{ 



+ BqeAIdM^[z]) 



P{D)Y{t)^Q{D)DUt), 



-4. 



(3.1a) 



(3.1b) 



(3.2) 



which is the continuous-time analog of the discrete-time ARMA equations. We note that 
we allow for the driving Levy process L and the L-driven MCARMA process to have 
different dimensions and thus slightly extend the original definition of [19]. All the results 
we need from [19] are easily seen to continue to hold in this more general setting. Since, 
in general, Levy processes are not differentiable, equation (3.2) is purely formal and, as 
usual, interpreted as being equivalent to the state space representation 



dG{t)=AG{t)At + Bd'L{t), 
where A,B,C are given by 

/ Id 

Iw 



Y{t)=CG{t), te. 



(3.3) 



A: 











-A 



B=ipJ 



p-i 



lid 
-A J 



eMpd(R), 



(3^)'€Mpd,mm 

-l{0,....,q}{j) 






B„ 



(3.4a) 



(3.4b) 



and 



c = (id,Od,...,Od)eAfd,pd( 



(3.4c) 



In view of representation (3.3), MCARMA processes are linear continuous-time state 
space models. We will consider this class of processes and see that it is in fact equivalent 
to the class of MCARMA models. 

Definition 3.1. An W^ -valued continuous-time linear state space model (A, i?,C, L) of 
dimension N is characterized by an R™'-valued driving Levy process L, a state tran- 
sition matrix A e Mn(R.), an input matrix B € Afjv,Tn(K) o-nd an observation matrix 
C £ Afd,Af(R). It consists of a state equation of Ornstein-Uhlenbeck type 



dX(t) = ylX(t) dt + B dL(i) 



(3.5a) 
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and an observation equation 

Y{t)=CX{t). (3.5b) 

The M.^ -valued process X = (X(i))igK *s the state vector process and Y = (Y(i))tgR is 
the output process. 

A solution Y to equations (3.5) is called causal if for all t, Y{t) is independent of the 
a-algebra generated by {L(s) ■.s>t}. Every solution to equation (3.5a) satisfies 

X(t):=:c^(*-^)X(.s)+ f c'^(*-"'BdL(u), s,ieM, s<t. (3.6) 

The independent increment property of Levy processes implies that X is a Markov pro- 
cess. We always work under the following standard causal stationarity assumption. 

Assumption El. The eigenvalues of A have strictly negative real parts. 

The following is well known [25] and recalls conditions for the existence of a stationary 
causal solution of the state equation (3.5a) for easy reference. 

Proposition 3.2. // Assumptions LI and El hold, then equation (3.5a) has a unique 
strictly stationary, causal solution X given by 

X{t)= f e'^(*-")BdL(w), ieM, (3.7) 

J — OO 

which has the same distribution as L g Bd'L{u). Moreover, X(i) has mean zero, 

/•OO 

Var(X(i)) = EX(t)X(i)'r =: Fo = / C^^BE^S'^e'^^" du, (3.8a) 

Jo 

Cov(X(i + /i),X(i))=EX(t + /i)X(t)'^=c'^'To, h>0, (3.8b) 

and Fo satisfies ATq + TqA^ = -BY.^B'^. 

It is an immediate consequence that the output process Y has mean zero and auto- 
covariance function h i~-> 7y(/^) = Ce^''FoC'^, and that Y can be written as a moving 
average of the driving Levy process as 

/OO 
g{t~u)dL{u), teR; g{t) =Ce^'BI^^^^){t). (3.9) 

-OO 

These equations serve, with A, B and C defined as in equations (3.4), as the definition 
of an MCARMA process with autorcgrcssivc and moving average polynomials given by 
equations (3.1). It shows that the behavior of the process Y depends on the values of the 
individual matrices A, B, C only through the products Ce^^'B, t S R. These products are, 
in turn, intimately related to the rational matrix function H : zi-^ C{zIn — A)~^B, which 
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is called the transfer function of the state space model (3.5). A pair (P, Q), P G Md(]R[2;]), 
Q € Md.m(^[z])-, of rational matrix functions is a left matrix fraction description for 
the rational matrix function H e Md{R{z}) if P{z)-'^Q{z) = H{z) for all z € C. The 
next theorem gives an answer to the question of what other state space representations 
besides (3.3) can be used to define an MCARMA process. The proof is given in Section 5. 

Theorem 3.3. // {P,Q) is a left matrix fraction description for the transfer function 
z f-> C'{z1n — A)^^B, then the stationary solution Y of the state space model {A, B, C, L) 
defined by equations (3.5) is an h-driven MCARMA process with autoregressive polyno- 
mial P and moving average polynomial Q. 

Corollary 3.4. The classes of MCARMA and causal continuous-time state space models 
are equivalent. 

Proof. By definition, every MCARMA process is the output process of a state space 
model. Conversely, given any state space model {A, B, C, L) with output process Y, [10], 
Appendix 2, Theorem 8, shows that the transfer function H:zi-^ C{zIm — A)~^B pos- 
sesses a left matrix fraction description H{z) = P{z)^^Q{z). Hence, by Theorem 3.3, 
Y is an MCARMA process. D 

4. Complete regularity of the innovations of 
a sampled MCARMA process 

For a continuous-time stochastic process Y — (Y(f))tgR and a positive constant h, the 
corresponding sampled process Y^'^ = (Y„ ')nez is defined by Y„ ' —Y{nh). A com- 
mon problem in applications is the estimation of a set of model parameters based on 
observations of the values of a realization of a continuous-time process at equally spaced 
points in time. In order to make MCARMA processes amenable to parameter inference 
from equidistantly sampled observations, it is important to have a good understanding 
of the probabilistic properties of Y^''). One such property which has turned out to be 
useful for the derivation of asymptotic properties of estimators is mixing, for which there 
are several different notions (see, e.g., [4] for a detailed exposition). Let / denote Z or R. 
For a stationary process X = (X„)„g/ on some probability space (f2,^,P), we write 
^™ — <j{Xj :jEl,n<j< m), — oo <n<m< oo. The a-mixing coefficients {a{m)),nei 
are then defined by 

a{m)^ sup \V{Ar\B)-¥{A)¥{B)\. 

If lim,„_>.oo a("T.) =0, then the process X is called strongly mixing, and if there exist 
constants C > and < A < 1 such that am < CA™, m > 1, it is called exponentially 
strongly mixing. The /3-mixing coefficients (/3{m))m,:i are similarly defined as 

/3(m)==E sup |P(B|^^^)-P(S)|. 
-Be,F£f 
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If liuim^oo Pi'm) =0, then the process X is called completely regular or /3-mixing, and 
if there exist constants C > and < A < 1 such that /3m < CA™ , to > 1 , it is called 
exponentially completely regular. It is clear from these definitions that a (to) < /3(to) and 
that (exponential) complete regularity implies (exponential) strong mixing. It has been 
shown in [19], Proposition 3.34, that every causal MCARMA process Y with a finite Kth 
moment, k > 0, is strongly mixing and this naturally carries over to the sampled pro- 
cess Y'^''). In this paper, we therefore do not investigate the mixing properties of the 
process Y'''^ itself, but rather of its linear innovations. 

Definition 4-1- Let (Y„)„gz be an R'^ -valued stationary stochastic process with finite 
second moments. The linear innovations (en)nGZ of (Y„)„gz H'^e then defined by 

£n ~ Y„ — P„_iY„, P„ ~ orthogonal projection onto spanjYj^ : — oo < ly < n}, 

(4.1) 
where the closure is taken in the Hilbert space of square-integrable random variables with 
inner product {X, Y) i-)- E(X, Y) . 

From now on, we work under an additional assumption, which is standard in the 
univariate case. 

Assumption E2. The eigenvalues Ai, . . . , Ajv of the state transition matrix A in equa- 
tion (3.5a) are distinct. 

A polynomial p e Md{C[z\) is called monic if its leading coefficient is equal to I^ and 
Schur-stable if the zeros of z i— > dctp(z) all lie in the complement of the closed unit disc. 
We first give a semi-explicit construction of a weak VARMA representation of Y*^'*^ with 
complex- valued coefficient matrices, a generalization of [7], Proposition 3. 

Theorem 4.2. Assume that Y is the output process of the state space system (3.5) 
satisfying Assumptions LI, El, E2, and Y*-'*' is its sampled version with linear innova- 
tions e^^'. Define the Schur-stable polynomial (p G C[z] by 

N 

^{z) = n (1 - e''^"^) =: (1 - ^1^ ^NZ^). (4.2) 

There then exists a monic Schur-stable polynomial Q G Md{C[z]) of degree at most N —1 
such that 

^(i?)YW- 6(5)6 W, neZ, (4.3) 

where B denotes the backshift operator, that is, -B^ Y„ = Y„_ for every non-negative 
integer j . 

This result is very important for the proof of the mixing properties of the innovations 
sequence e^^"^ because it establishes an explicit linear relationship between e^''^ and Y^''^ 
A good understanding of the mixing properties of e'''-' is not only theoretically interesting, 
but is also practically of considerable relevance for the purpose of statistical inference 
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for multivariate CARMA processes. One estimation procedure in which the importance 
of the mixing properties of the innovations of the sampled process is clearly visible is 
Gaussian maximum likelihoood (GML) estimation. Assume that O C M** is a compact 
parameter set and that a parametric family of MCARMA processes is given by the 
mapping 9 ^ i— >■ (A^, i?,?, C,?, L^). It follows from Theorem 4.2 and [8], Section 11.5, that 
the Gaussian likelihood of observations y^ = (yi, . . . ,yi) under the model corresponding 
to a particular value •& is given by 

J^^.{d)^{2n)-^''/^lf{detV^A exp|-iX^eJ^„y^;>^,„l (4.4) 

where 6,5. „ is the residual of the minimum mean-squared error linear predictor of y„ 
given the preceding observations, and V^^n is the corresponding covariance matrix. From 
a practical perspective, it is important to note that all quantities necessary to evaluate 
the Gaussian likelihood (4.4) can be conveniently computed by using the Kalman recur- 
sions ([8], Section 12.2) and the state space representation given in Lemma 5.2. In case 
the observations y^ are (part of) a realization of the sampled MCARMA process Y^ 
corresponding to the parameter value t9o, the prediction error sequence (e^Q^„)„>i is - 
up to an additive, exponentially decaying term which comes from the initialization of the 
Kalman filter - (part of) a realization of the innovations sequence e'''^ of Y^ . In order 
to be able to analyze the asymptotic behavior of the natural GML estimator 

??^=argmax^yi.(i9) 

in the limit as L — > 00 , it is necessary to have a central limit theorem for sums of the form 
1 ^ d 

77 Zl 7m [log '^'^^ ^''." + ei'.n^>?T"'5'5." 



^/L^,^^ 



71=1 



(4.5) 

1?=1?0 



Existing results in the literature [4, 15] ensure that various notions of weak dependence, 
and, in particular, strong mixing, are sufficient for a central limit theorem for the ex- 
pression (4.5) to hold. Theorem 4.3 below is thus the necessary starting point for the 
development of an estimation theory for multivariate CARMA processes which involves 
some additional issues like identifiability of parametrizations and is thus beyond the scope 
of this paper. 

Before presenting the sufficient condition for the innovations e^^' to be completely 
regular, we first observe that the eigenvalues Ai, . . . , \m of A are the roots of the char- 
acteristic polynomial z 1— >■ det(zlAr — A), which, by the fundamental theorem of algebra, 
implies that they are either real or occur in complex conjugate pairs. We can therefore 
assume that they are ordered in such a way that for some r g {0, . . . , N}, 



Ai. e R, 1 < z^ < r, K = K+i e C\K, i^ = r + l,r + 3, ...,iV-l. 

By Lebesgue's decomposition theorem [16], Theorem 7.33, every measure jjl on W^ can 
be uniquely decomposed as /x = /Xc -I- /Xg , where jjLc and /ig are absolutely continuous and 
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singular, respectively, with respect to the d-dimensional Lebesgue measure. If //c is not 
the zero measure, then we say that fi has a non-trivial absolutely continuous component. 

Theorem 4.3. Assume that Y is the output process of the continuous-time state space 
model {A, B, C, L) satisfying Assumptions LI, El and E2. Denote by e^^' the innovations 
of the sampled process 'Y^^i and further assume that the law of the W"'^ -valued random 
variable 



where 



mI'')^ ... mI'')^ mI+\^ M%^ ... M^^lJ 



lT 



(4.6) 



M^,'') : 






ReM[,''^ ImMi''^ 



mI^'>^ e(''-"'^-dL(w), i/ = l,...,A^, (4.7) 







has a non-trivial absolutely continuous component with respect to the mN -dimensional 
Lebesgue measure. Then, e^^' is exponentially completely regular. 



The assumption on the distribution of ^^ ' made in Theorem 4.3 is not very restric- 
tive. Its verification is based on the following lemma, which allows us to derive sufficient 
conditions in terms of the Levy process L which show that it is indeed satisfied in most 
practical situations. 

Lemma 4.4. There exist matrices G S MmNi^) and H S MmN.mi^) such that ./^^''^ = 
^{h), where (^(t))t>o is the unique solution to the stochastic differential equation 

d^{t)^G.Jf{t)dt + HdL(t), ^(O)=0™7v (4.8) 

Moreover, rankiJ = m and the mN x mN matrix [H GH ■ ■ ■ G^^^H\ is non-singular. 

The last part of the statement is referred to as controllability of the pair (G, H) and 
is essential in the proofs of the following explicit sufficient conditions for Theorem 4.3 to 
hold. 

Proposition 4.5. Assume that the Levy process L has a non-singular Gaussian covari- 
ance matrix S^. Theorem 4-3 then holds. 



Proof. By [24], Corollary 2.19, the law of ^' ' is infinitely divisible with Gaussian co- 
variance matrix given by L e'^'^ HYP H"^ c'^ " Au. By the controllability of (G, H) and [3], 
Lemma 12.6.2, this matrix is non-singular and [23], Exercise 29.14 completes the proof. D 

A simple Levy process of practical importance which docs not have a non-singular 
Gaussian covariance matrix is the compound Poisson Process, which is defined by 

L(t) = X]n=i "^"' where (A^(i))tgK+ is a Poisson process and (J„)„gz is an i.i.d. sequence 
independent of (A'^(i))tgR+; the law of J„ is called the jump size distribution. The proof 
of [22], Theorem 1.1, in conjunction with Lemma 4.4, implies the following result. 
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Proposition 4.6. Assume that L is a compound Poisson process with absolutely con- 
tinuous jump size distribution. Theorem 4-3 then holds. 

Under a similar smoothness assumption, the conclusion of Theorem 4.3 also holds in 
the case of infinite activity Levy processes. The statement follows from applying [22], 
Theorem 1.1, to equation (4.8). 

Proposition 4.7. Assume that the Levy measure v^ ofL satisfies i^'^(IR'") = oo and that 
there exists a positive constant p such that v^ restricted to the ball {x G M™ : ||x|| < p] has 
a density with respect to the m-dimensional Lebesgue measure. Theorem 4-3 then holds. 

While the preceding three propositions already cover a wide range of Levy processes 
encountered in practice, there are some relevant cases which are not yet taken care of, 
in particular, the construction of the Levy process as a vector of independent univariate 
Levy processes (Corollary 4.11 below). To also cover this and related choices, we employ 
the polar decomposition for Levy measures [2], Lemma 2.1. By this result, for every Levy 
measure ly^, there exists a probability measure a on the {m — l)-sphere S"^~^ := {x € 
M™ : ||x|| =1} and a family {t'^ :^ € S"^~^} of measures on R+ such that for each Borel 
set B e S(R+), the function ^ h^ vs,{B) is measurable and 

^^{B)= f f lB{X^H{dX)a{d^), Be6(R"\{0™}). (4.9) 

A hyperplanc in a finite-dimensional vector space is a linear subspace of codimension one. 

Proposition 4.8. // the Levy measure v^ has a polar decomposition {a^V(_ :^ € S*™^^) 
such that for any hyperplanc TL C R™, it holds that Jam-i ^r™\-h(^) /n ^'^(dA)a(d^) = cxj, 
then Theorem 4-3 holds. 

Proof. The proof rests on the main theorem of [26]. We denote by imif the image 
of the linear operator associated with the matrix H. Since laukH ~ m and the pair 
(G, H) is controllable, we only have to show that i^'^dx € M™ : Hx e iirH\T-L}) = oo 
for all hyperplanes H C imH, and since M'" =iinH, the last condition is equivalent to 
v^iW^XH) = oo for aU hyperplanes n C M™. Using equation (4.9) and the fact that for 
every £ € S"^~^ and every A G R^, the vector A^ is in H if and only if the vector ^ is, 
this is seen to be equivalent to the assumption of the proposition. D 

Corollary 4.9. // the Levy measure v^ has a polar decomposition (a, v^:£^^ S"^~^) such 
that a{S'^^^\'H) is positive for all hyperplanes % G R™ and t'|(M+) = oo for a-almost 
every ^, then Theorem 4-3 holds. 

Corollary 4.10. // the Levy measure v^ has a polar decomposition [a^v^^-.S^ G S™"^^) 
such that for some linearly independent vectors ^j, . . . ,^„ G 5™^^, it holds that a(^fe) > 
and V(_^{M.'^) = oo for fc = 1, . . . ,m, then Theorem 4-3 holds. 
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Corollary 4.11. Assume that I >m is an integer and that the matrix R € Mm,i(K) has 
full rank m. If h = R (Li • • • Li) , where L^, fc = 1, . . . , /, are independent univariate 
Levy processes with Levy measures v^ satisfying v^{^) =oo, then Theorem 4-3 holds. 

5. Proofs 

5.1. Proofs for Section 3 



Proof of Theorem 3.3. The first step of the proof is to show that any pair {P,Q) of 
the form (3.1) is a left matrix fraction description of C{zlpd — A)~^B, provided A, B 
and C are defined as in equations (3.4). We first show the relation 

{z\d-A)-^B^[w^{z)^ ■■■ w];{z)f, (5.1) 

where Wj{z) £ AId,m{^{z}), j ^ 1, . . . ,p, arc defined by the equations 

Wj{z)^-{wj+i{z)+l3j), j = l,...,p-l, (5.2a) 






and 

^p(-^) = 7 ( - U Ap^kWk+i (z) +/3p]. (5.2b) 

Since it has been shown in [19], Theorem 3.12, that wi{z) = P{z)^^Q{z) this will prove 
the assertion. Equation (5.1) is clearly equivalent to S = (zlpc; — ^) [wi(z)"'' ••• i(jj(z)] , 
which explicitly reads 

/3j = zwj{z)-wj+i{z), j = l,...,p-l, 
/3p = zwp{z) + ApWi{z) H + AiWp{z) 

and is thus equivalent to equations (5.2). 

For the second step consider a given state space model {A, B, C, L). Using the spectral 
representation [17], Theorem 17.5, 



^At 



-^ [ c'*{zlN^A)-^dz, teR, (5.3) 

2711 Jr 



where F is some closed contour in C winding around each eigenvalue of A exactly once, 
it follows that 

Y{t)= f Ce'^(*-")SdL(M) = — / /e"(*-")C(zlN-yl)-iBdzdL(ii) 
J-oc 27ti 7_^ Jr 

1 ft r 

I I e^(*— )p(2)-iQ(z)dzdL(w) 



27ti.y_ooJr 
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f Cc'^(*-")i3dL(M), 
^ — 00 



where A, B and C arc defined in terms of {P,Q) by equations (3.4). Tlius Y is 
an MCARMA process with autoregressive polynomial P and moving average polyno- 
mial Q. n 



5.2. Proofs for Section 4 

In this section we present the proofs of our main results, Theorem 4.2, Theorem 4.3 and 
Lemma 4.4, as well as several auxiliary results. The first is a generalization of [7], Propo- 
sition 2, expressing MCARMA processes as a sum of multivariate Ornstein-Uhlcnbeck 
processes. 

Proposition 5.1. Let Y be the the output process of the state space system (3.5) and 
assume that Assumption E2 holds. Then, there exist vectors Si,...,sjv G C™\{0,„} and 
bi, . . . jb^r G C'^\{Od} such that Y can he decomposed into a sum of dependent, complex- 
valued Ornstein-Uhlenheck processes as Y(t) =^^,^1'^ i^{t) , where 

Y^(i)=c-^-('-^'Y^(.s)+b^ / e^-(*-"'d(s^,L(w)), s,teR, s<t. (5.4) 



Proof. We first choose a left matrix fraction description (P, Q) of the transfer function 
z I— > C{z1m — A)~^B such that z 1— ?► detP(z) and z !—> dctQ(z) have no common zeros 
and z 1-^ det P{z) has no multiple zeros. This is always possible, by Assumption E2. 
Inserting the spectral representation (5.3) of e^* into the kernel g{t) (equation (3.9)), we 
get g{t) = 2^ /pe^*C(2;l7v — ^)~^-Bdz/[o,oo)(0 and, by construction, the integrand equals 
e^^P{z)~-^Q{z)I[Qao'){t). After writing P{z)^^ = jctp(z) ^djP(z), where adj denotes the 
adjugate of a matrix, an elementwise application of the residue theorem from complex 
analysis ([11], Theorem 9.16.1) shows that 



m-E 



^ 1 



^^j^^^,^^adjP(A.)g(A.)/,,«,)(0, 



where (detP)'(Aiy) := ^^ dctP(z)|2=A„ is non-zero because zM-detP(z) has only simple 
zeros. The same fact, in conjunction with the Smith decomposition of P ([3], Theo- 
rem 4.7.5), also implies that rankP{X^) = d— 1 and thus rankadjP(Ay) = 1 ([3], Fact 
2.14.7(ii)). Since detP and detQ have no common zeros, [(detP)'(Ai/)]~^ adj P{X,y)Q{X,y) 
also has rank one and can thus be written as b^^sj^ for some non-zero s,y G C™ and b,y G C^ 
([13], Section 51, Theorem 1). D 
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Lemma 5.2. Assume that Y is the output process of the state space model (3.5). The 
sampled process 'Y^^> then has the state space representation 

I'nh 

X„ = c^'^X„_i+N„, N„=/ e^("''-")BdL„, Y^'') = CX','') . (5.5) 

J(n-l)h 



The sequence (N„)„gz is i.i.d. with mean zero and covariance matrix 

eh 



Jo 



AuTjx^LjjT^A^u 



du. 



(5.6) 



Proof. Equations (5.5) follow from setting t = nh, s = {n — l)h in equation (3.6). It 
is an immediate consequence of the Levy process L having independent, homogeneous 
increments that the sequence (N„)„gz is i.i.d. and that its covariance matrix ^ is given 
by equation (5.6). D 

From this, we can now proceed to prove the weak vector ARMA representation of the 
process Y^''^ 

Proof of Theorem 4.2. It follows from setting t = nh, s= [n— \)h in equation (5.4) 



r(h) 



r(h) 



N ^{h) 



r{h) 



that Y„ can be decomposed as Y„ = X]i/=i~^^'>ni where Yj> , satisfying 

YW^e^.'»Y(;i, + Z(^, ZW=b. / e^"("''-")d(s„L(^)), 

J(n-l)h 

are the sampled versions of the component MCAR(l) processes from Proposition 5.1. 
Analogously to [9], Lemma 2.1, we can show by induction that for each /c e No and all 
complex d X d matrices ci , . . . , Cfc , it holds that 



fc-1 r 



,\,,hk 



E 



^ gA„/i(fc-r) 



Y 



CO 

u,n — k 



+E 

r=0 






(5.7) 



f{h) 



If we then use the fact that e ^^" is a root of z i—> (p[z), which means that c^''^" 
(pic^^""'^^'''^"" — ... — (^jv = 0, and set k = N, c,. = Idfr, then equation (5.7) becomes 



N-l 



^{B)Yi':i = J2 



r=0 



rhX^ 






,ih) 



Summing over v and rearranging shows that this can be written as 

N 

^iB)Yi'^ =J2vi'l^^„ 



(5.8) 
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where the i.i.d. sequences {Vv,n)ne.i, v £{1,.. ., N}, are defined by 



S/W 



rnh N 


v-1 


. >>'' 


^xM^-1) _ \ ' ^^^x^Hu-K-1) 


("-1)'V=1 


K=l 



3^" ("''-") d(s,,,L(w)). (5.9) 



By a straightforward generalization of [8], Proposition 3.2.1, there exists a monic Schur- 
stable polynomial Q{z) = Id + 6iz H — • + Qn-iz^'^ and a white noise sequence e such 
that the {N — l)-dependent sequence ip{B)Y'^'^^ has the moving average representation 

(p(i?)Y,i = 9(i3)e„. Since both tp and are monic, and tp is Schur stable (by Assump- 
tion El), £ is the innovation process of Y^''^ and so it follows that e = e^'*^ because the 
innovations of a stochastic process arc uniquely determined. D 

As a corollary, we obtain that the innovations sequence e'^''^ itself satisfies a set of strong 
VARMA equations, the attribute strong referring to the fact that the noise sequence is 
i.i.d., not merely white noise. 

Corollary 5.3. Assume that Y is the output process of the state space system (3.5) 
satisfying Assumptions LI, El and E2. Further assume that e'''-* is the innovations 
sequence of the sampled process Y"'^' . There then exists a monic, Schur-stable polynomial 
O G Mci(C[z]) of degree at most N —1, a polynomial 6 € Md.dN(^[z]) of degree N —1 and 
a C^^ -valued i.i.d. sequence W^'"' ~ (W„ )riGZ, such that 

e{B)el^'> ^ e{B)Wi^\ neZ. (5.10) 

Proof. Combining equations (4.3) and (5.8) gives 



^ l,n + ^2.n-l ^ ^ ^ N.n-N+1^ " ^ ^' 



(5.11) 



and with the definitions 



"^n^^lvif ... V(,^)7]%C'^^ neZ, (5.12a) 



N 

K = [Od ■■■ Od Id Od ••• Od]eMd,dAr(M), 1^ = 1,. ..,N, 



(5.12b) 



f—l times N—v times 

equation (5.11) becomes Q{B)en = ^(B)W„ , showing that e'^''^ is indeed a vector 
ARMA process. D 

This corollary is the central step in establishing complete regularity of the innovations 
process e^''^. 
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where 



rih) 



fih) 



rCO 



(h) 



tW 






neZ, 



MC*) 



RcMI'^^ ImM, 



CO 



M, 



{h) 



nh 



{n-l)h 



^Ay (nh—u) 



dL(u), v = l,...,N, ne 



Clearly, the sequence {^n )nez is i.i.d. and ^^''^ is equal to ^i . We now argue 



(h) 



Ah) 



that the vector W„ , as defined in equation (5.12a), is equal to a linear transforma- 

tion of .^i''' . By equation (5.9), wl'' = [F^ ® I^] [(biS^Mi';) )T . . . (bArs^ mI';]^)^] ^, 

where T ^ (7^,^) e Afjv(C) is given by 7^,^ = c^M'^-i) + ^^-1 ^^^^^M'^-^^-i) , with the 
notation 



B 



Orf b2 
Vorf ... 



Od\ 



■■• Od 

Od bAr/ 



€MdN,Ni<C), S- 






oJ\ 



ol 

T ^T 



€ AIn^„in{C), 



yoi ••■ oi s^/ 



we get 



(bisTMi':))T ... (b^sTMi';^)T 



== B5 






We recall 



that for i' = r + l,r + 3,...,iV— 1, the eigenvalues of A satisfy Xi, — X^+i G C\M, which 
implies that 



Mi^l = Re Mi^^l + i Im M^.'^) and M^'^^^^ = MII^ = Re M^';) - i Im M^l^ 



Consequently, we obtain that 






= [K (E) I„ 



(h) 



■mW^f^n -i 



where 



/Ir 



K = 



V 



J) 



eM^iC), J=(] \Y 



so that, in total, Wjf ^ = F^k' with F = [r'^ ® h]BS[K ® I„] e MdN,mN{C). It fol- 
lows that the VARMA equation (5.10) for e^*) becomes Q{B)e'l'^ =e{B)^i^\ where 
0{z) = 6{z)F. By the invertibility of 8, the transfer function fc : z 1— >■ Q{z)~^9{z) is an- 
alytic in a disc containing the unit disc and permits a power series expansion k(z) = 
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Sfco^i'^"'- ^'^ next argue that the nupulse responses '^j are necessarily real d x mN 
matrices. Since both e„ and ^„ are real-valued, it follows from taking the imagi- 
nary part of the equation £„ = k{B)^n that 0,^ = S^lo-^^^i-^n-r Consequently, 
= Cov(0(i) = X^i^o^^^i Cov(^^J-)Im^J and since each term in the sum is a pos- 
itive semidefinite matrix, it follows that Im^l^j Cov(^„_ Jlm^pJ = for every j. The 
existence of an absolutely continuous component of the law of ^„_, with respect to 

the mA^-dimensional Lebesgue measure implies that Cov(^„_ ■) is non-singular and it 
thus follows that ImVP^ = for every j. Hence, k{z) £ Md^mN{^) for all real z, and 
consequently k £ Md^mN{^{z})- [14], Theorem 1.2.1(iii), then implies that there exists 
a stable (^„ )„gN-driven VARMA model for e''*' with real- valued coefficient matrices. 
It has been shown in [20], Theorem 1, that a stable vector ARM A process is geometri- 
cally completely regular provided that the driving noise sequence is i.i.d. and absolutely 
continuous with respect to the Lebesgue measure. A careful analysis of the proof of this 
result shows that the existence of an absolutely continuous component of the law of the 
driving noise is already sufficient for the conclusion to hold. We briefly comment on the 
necessary modifications to the argument. We first note that under these weaker assump- 
tions, the proof of [20], Lemma 3, implies that the n-step transition probabilities P"(x, •) 
of the Markov chain X associated with a vector ARMA model via its state space rep- 
resentation have an absolutely continuous component for all n greater than or equal to 
some TiQ. This immediately implies aperiodicity and (/)-irreducibility of X, where cf) can 
be taken as the Lebesgue measure restricted to the support of the continuous component 
of P""(x, •). The rest of the proof, in particular the verification of the Foster-Lyapunov 
drift condition for complete regularity, is unaltered. This shows that e'^''^ is geometri- 
cally completely regular and, in particular, strongly mixing with exponentially decaying 
mixing coefficients. D 

Proof of Lemma 4.4. By definition, Ml^ = Mi,(/i), where (M,y(t))(>o is the solution 
to 

dM„(t) ^ A^M^(i) At + dL(t), M^(0) = 0„. 

Taking the real and imaginary parts of this equation gives 

dReM^(t) = Re A^M^(t) dt + dL(t) = [Re K RcM^(i) - Ln A^ lmm^{t)] At + dL(i), 
dlmM^(t) =:ImA,^Mi.(t)dt= [Re A,^ImM^(i) -MmA^ReM^(i)] di, 

and consequently 

'^VlmM.W j -[^^®^™] (,ImM.(t) j ^*+U™J ^ ^' ^""^Wk RcA. 



Using the fact that A^ € M for v = 1,. . .,r and Xi, = \u+i G C\M for v = r 
l,r -I- 3, ...,iV - 1, it follows that ^^''^ = ^{h), where {^{t))t>o satisfies d./#(<) 
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G^{t) At + iJdL(i), and G = G (g) !„, G A/„jAr(R) and H = H ® I„, e MmN m are given 

by 

G = diag(Ai, . . . , A^, A^+i, A^+s, . . . , Aat-i), 
il={\ ••• 1 1 1 ••• 1 0)'^. 

r times 

Since ranki7 — ?n, the first claim of tlie lemma is proved. Next, we show that the con- 
trollability matrix "€ := [U GH ■■■ G^~^H\ G M^n^) is non-singular. With ^ := 

H and by the properties of the Kronecker product, it follows that 



R GB ■■■ G 



N-\ 



and thus det*^ = [def^]™. The matrix '£ is given explicitly by 



/I 



Ai 



A? 



Af-i 



\ 



1 A^ \l 

1 ReAr+i ReA^^_]^ 
ImAr+i IniA^^]^ 



\Af-l 

Re A^^]^ 
ImAf+-,i 



1 RcAat-i ReA^ 



JV-l 
2 



Re A 






\0 IniA7v_i ImAj^_]^ 






= T 



ImA^^lJ/ 



Ai 

Ar+1 
iAr+1 



A? 



>2 



iA,Vi 



,Af-l 



N- 









2 



1 Aftr-i A 

\i iAjv-i iA^_i 



A 



with T G A/Ar(R) given by T = diag(l, . . . , 1, i?, . . . , i?), i? = 3 , j ^ 

mula for the determinant of a Vandermonde matrix ([3], Fact 5.13.3) implies that 



. Hence, the for 



det<; 



(_l)(A^-'-)/2 -Q (A^^_A,) n ImA,JA,,-A,|^ 

l</i<z^<r 






X |A^-A,|^ 



n 1^. 



l<M<r 



where Ir.N = {r + 1, r + 3, . . . , A^ — 1}. Hence, def^^ is not zero by Assumption E2 and 
the proof is complete. D 
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